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For the zone of moderate deviation probabilities the local asymptotic minimax 
lower bound of asymptotic efficiency of estimators is established. The estimation 
parameter is multidimensional. The lower bound admits the interpretation as 
the lower bound of asymptotic efficiency in confidence estimation. 



1 Introduction 



The asymptotic normality of estimators is a key property allowing to construct 
confidence sets if the sample size is sufficiently large. The problem of accuracy of 
the normal approximation emerges simultaneously with its implementation. The 
inequalities of the Berry-Esseen type and the Edgeworth expansions (see [T3| [5j [23], 
[T4"] and references therein) show that the convergence rate to the normal distribution 
has the order n _1//2 ( here n is a sample size). The significant levels a of confidence 
sets have usually small values ( a = 0.1; 0.05; 0.01 are the standard values in practice 
). For such small values of a the rate of convergence n -1 / 2 does not allow to talk 
about adequate accuracy of approximation for the sample sizes of several hundreds 
observations or smaller. From this viewpoint the study of asymptotic properties of 
estimators in the zones of large and moderate deviation probabilities is of special 
interest. The problem of lower bounds for asymptotic efficiency in these zones 
emerges as well. The asymptotic efficiency of estimators in the zone of large deviation 
probabilities is analyzed on the base of Bahadur efficiency [3j [281 122 122] . 

The study of large deviation probabilities of estimators is a rather difficult 
problem. This problem is often replaced with the study of their moderate deviation 
probabilities. Let X\, . . . ,X n be independent sample of random variable X having 
the probability measure Pe,9 e R 1 . Let b n > 0, b n -> 0,n& 2 — > oo as n — > oo. Let 
9 e R 1 . Then (see [11]) for any estimator 9 n 

lim inf inf ife 2 )" 1 In P (\9 n - 9\ > b n ) > -I(9 Q ). (1.1) 

n->oo 9=9 ,9 +2b„ 2 

Here we suppose that there exists the finite Fisher information 1(9) for all 9 in some 
vicinity of 9$. Note that the lower bound of the local Bahadur asymptotic efficiency 
is a particular case of (11. ip . 

The natural problem arises on the quality of logarithmic approximation for 
the obtaining confidence sets. The distributions of estimators admit usually the 
approximation by the sums X = n~ 1 (X 1 + . . .+X n ) of independent random variables, 
(see [25| [28| [T4"] and references therein). Thus it is of interest to compare for the 
sample mean X the confidence intervals obtained by the normal approximation 
and the basic term of logarithmic asymptotic. If there exists an exponential moment 
£7[exp{t|Xi|}] < C < oo, t > 0, the sample mean X satisfies the Bernstein inequality 

P(n x / 2 (X - EiXt}) >x)< exp + o(l)) J , x > x (1.2) 

with a 2 = VarfXt]. 

The confidence interval based on the main term of asymptotics of right-hand 
side of (11. 2p is the following 

v- aV2\Ha/2)\ - | a^2\ ln(a/2)| \ 
y/n y/n J 

instead of the standard one 

X - x a/2 ^=,X + x a/2 ^= ) (1.4) 



n \/n 
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where x a /2 satisfies a/2 = $(— i a / 2 ). Here is the standard normal distribution 
function. 

If a = 0.1 ; 0.05; 0.01 respectively the confidence intervals defined by (ll.3p are the 
following 

(X - 2.44^=, X + 2.444=), 



(X-2.71^,X + 2.71^), 

Jn Jn 



(X - 3.254=, X + 3.254=) 



instead of the standard ones defined by the normal approximation (jl.4p 

{X - 1.654=, X + 1.654=), 



(X- 1.964=, x + 1-964=), 

In Jn 



(X - 2.576 4=, X + 2.5764=) 

m Jn 



If a = 0.1; 0.05, the implementation of (11.31) requires the doubling of the number of 
observations for obtaining the same width of confidence interval as in ( 11. 4p . At the 
same time the normal approximation works in a rather narrow zone of moderate 
deviation probabilities in comparison with the Bernstein inequality (11.21) . Thus the 
analysis of confidence intervals on the base of logarithmic asymptotics of large 
and moderate deviation probabilities is also reasonable. It should be noted that 
there exist powerful methods for constructing accurate boundaries of confidence 
intervals such as asymptotic expansions (see [TBI H4"l El [23j [26] and references therein) , 
bootstrap (see [HI EJ |28j E] and references therein) and so on. 

For the zone of moderate deviation probabilities the normal approximation of 
statistics is the subject of numerous publications (see 0, [Lj [H HH [231 EH EH] an d 
references therein). The goal of the paper is to prove the sharp local asymptotic 
minimax lower bound for the estimators in this zone. The estimation parameter is 
multidimensional. For one - dimensional parameter the local asymptotic minimax 
lower bound for the sharp asymptotics of moderate deviation probabilities of estimators 
has been established in [11] . Thus the local asymptotic minimax lower bound for 
estimators [T5l[T6l[T9l [27 , 28J is extended on the zone of moderate deviation probabilities. 

We make use of the letters C and c as generic notation for positive constants. 
Denote x(A) the indicator of set A, [a] - the integral part of a. For any u,v G R d 
denote u'v the inner product of u, v and v! the transposed vector of u. For positive 
sequences a n denote a n x b n , if c < a n /b n < C, and denote a n »> b n if a n /b n — > 00 
as n — > 00. For any set of events 5... denote A... the complementary event to 5.... 



2 Main Result 

Let Xi, . . . , X n be i.i.d.r.v.'s having a probability measure (p.m.) Pg,0 G C R d , 
defined on a probability space (S, T). Suppose p.m.'s Pg,9 G 6, are absolutely 
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continuous w.r.t. p.m. v denned on the same probability space (S, T). Denote 
f(x,6) = ^f-(x),x G S. For any 61,62 G R d denote Pg l6 and Pg e respectively 
absolutely continuous and singular components of p.m. P 0l w.r.t. Pg 2 . For all x G S 
such that f(x, 6)^0 denote a(x, 0, 6 + u) = (f(x, 6 + u)/f(x, 6)) 1 ' 2 -l,uE R d . 

The statistical experiment ^ = {(S, T), Pg, # G -R d } has the finite Fisher information 
at the point 6 G -R d if there exists the vector function = (0e,i(:r), . . . , (j)g t d(x))', x G 

5, G L 2 (Pg), 1 < i < d such that 

J^g( x ,e,e + u)-^u'M^ dP e = o(\u\ 2 ), Pi +Ute (S) = o(\u\ 2 ) 
as it — y 0. 

The Fisher information matrix at the point 6 equals 

1(6) = [ foti dP e . 
Js 

For any P 01 , Pg 2 , 61, 6 2 G R d the Hellinger distance equals 

p(P 01 ,Po 2 ) = P (6 U 6 2 ) = ( /(/ 1/2 (*A) - f 2 {x,6 2 )fdv 



We make the following assumptions. 

Let 60 G and let be open set. Let < A < 1. 
Al. For all 6 in some vicinity ©o of the point #0 G there exists the positive definite 
Fisher information matrix 1(6). 
A2. For all 6, 6 + u G O there hold 

(g(x,6,6 + u) - l -u'^(x)) 2 dP e < C\u\ 2+ \ Pg s +Uj6 (S) < C\u\ 2+ \ (2.1) 

\4p 2 (6, e + u)- u'I(6)u\ < C\u\ 2+X , (2.2) 

/ \M*)\ 2+X dPe <C <oo, (2.3) 
Js 

h'I(6)h - h'I(6 + u)h < C\h\ 2 \u\ x . (2.4) 

The constants C in fl2.lti2.4p do not depend on 6, 6 + u G ©o- 

We say that a set Q C -R rf is central-symmetric if x G f2 implies —a; G f2. 
We make the following assumptions 

Bl. The set Q is convex and central-symmetric. 

B2. The boundary dQ of the set Q is C 2 -manifold. 

B3. The principal curvatures at each point of dQ are negative. 

Denote Gaussian random vector in R d such that E( = 0, £7[CCl = I- Here / 

is the unit matrix. 

Theorem 2.1 Assume Al, A2 and B1-B3. Let nb 2 n ->■ oo,n& 2+A 0, b n - 6 n _i = 
o(n _1 6,^ 1 ) as n -)• 00. T/ien /or any estimator 6 n = 6 n (Xi, . . . , X n ) 

. P g (/ 1/2 (M^-fl)^) \ 1 ,„ ,N 

hmmt sup -7- , — 1/07 > 1 (2.5) 

with C n — > 00 as n 00. 
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Wolfowitz |29] was the first who pointed out the relationship of lower bounds of 
(I2.5|) -type with the problem of asymptotic efficiency in the confidence estimation. 

In [HE] Theorem O has been established for 6 e C R 1 if <^3)-<^ is valid. 
If d = 1, (J23D follows from (Q. Note that (J23J) is fulfilled evidently in the case of 
location parameter. If (12. 4 p does not valid, we could not take I 1 I 2 {6q) as the constant 
normalized matrix in (12.51) . 

In confidence estimation the set Q is usually a ball Q r having the center zero and 
the radius r > 0. In this case the asymptotic of denominator in (12.51) is known. 

Corollary 2.1 Let assumptions of Theorem \2.1\ be valid. Let Q = Q r . Then for any 
estimator 9 n = 8 n (Xi, . . . , X n ) 

liminf sup 2 d / 2 - 1 T{d/2)(n 1 /% n r) 2 - d exp{nb 2 n r 2 /2}P e (I 1/2 (e )(e n -e) £ b n Q r ) > 1 

n ^°° \e-e \<c n b n 

(2.6) 

with C n — > oo as n — )■ oo. 

If O is the ellipsoid Q a>r = \d : ^tl >r 2 ,9 = {0i}f = v ^ G i? 1 1 , a = fo}^, ^ = 

a 2 = • • • = o"fe > o"fc+i > • • • > <Jd > 0, we get the following asymptotic (see [20J) in 
the denominator of (12 .5p 

P(C ^ n 1 / 2 ^^,) = C fc (n 1 / 2 6 n r) fc - 2 exp{-n6 2 r 2 /2}(l + o(l)). (2.7) 

Here C fc = 2^/ 2 a 1 1 -*(r(A;/2))- 1 nt, + i(l " ^/«f)- 1/2 - 

The assumptions of Theorem 12.11 are rather weak. The sharp asymptotics of 
moderate deviation probabilities of likelihood ratio were established under the more 
restrictive assumptions (see [SI H El ES] and references therein). The lower bounds 
for moderate deviation probabilities do not require such strong assumptions (see 
[21 [11]) and are usually proved more easily than the upper bounds. 

The assumptions of Theorem 12.11 are different from the traditional assumption 
of local asymptotic normality. Thus Theorem 12.11 could not be straightforwardly 
extended on the models having this property. At the same time Al,A2 represent 
slightly more stable form of usual assumptions arising in the proof of local asymptotic 
normality. This allows to make use of the technique arising in the proofs of local 
asymptotic normality and to get the results similar to (12. 5p for other models of 
estimation. This problem will be considered in the sequel. 

For the semiparametric estimation the local asymptotic minimax lower bounds 
in the zone of moderate deviation probabilities have been established in [12]. In 
|12] the statistical functionals take the values in R 1 . The results were based on the 
assumptions that (I2.ltl2.3p hold uniformly for the families of "least-favourable "distributions. 
In the case of multidimensional parameter the additional assumptions (12. 4p arises 
only. Thus the difference is not very significant. 

The plan of the proof of Theorem 12. II is the following. In section 3 we outline the 
basic steps of the proof. After that the proof are given for the most simple geometry 
of the set Q. For the arbitrary geometry of set Q we point out the differences in 
the proof at the end of section 3. The key Lemmas 13. 1[ 13.21 are proved in section 4. 
The proof of Lemma 13.21 is based on new Theorems 14.11 and 14.21 on large deviation 
probabilities of sums of independent random vectors. The proofs of Theorems 14.11 
and 14.21 are given in section 5. The proofs of technical Lemmas of sections 3 and 4 
are given in section 6. 
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3 Proof of Theorem 



2.1 



To simplify the notation we suppose that 6q equals zero. Suppose the matrix I(6q) 
is the unit. 

For any 61,62 G denote 

= ln j§^y T M = {nsmf = <j> ei (X s ) 

with 1 < s < n. 

We will often omit 6 = 6 in notation. For example, we shall write £ a (9) = 
£,s{6o, 6),t s = t s (6q). The index s will be omitted for s = 1. For example, r = Ti(6 ). 

Denote ij) n = n~ 1 / 2 / _1 / 2 (6' ) Y^=i T s- Note, that (6 — do)' Y^=i T s * s the stochastic 
part of the linear approximation of logarithm of likelihood ratio. 

The reasoning is based on the standard proof of local asymptotic minimax lower 
bound [151 EE EH 123 [28]. In particular we make use of the fact that the minimax 
risk exceeds the Bayes one and study the asymptotic of Bayes risks. However, in this 
setup, the estimates of residual terms of asymptotics of posterior Bayes risks should 
have the order o(exp{— cn& 2 }). This does not allow to make use of the technique of 
local asymptotic normality 

n 

UO - n 1/2 u' n I 1/2 ?p n + -nu'Ju n = o P (l) (3.1) 

8=1 1 

in the zone \u n \ < Cb n of moderate deviation probabilities. This is the basic reason 
of differences in the proof. 

Instead of (13. ip we are compelled to prove that, for any e > 0, 



P ( sup J V£ s (w) - n 1/2 u'I 1/2 i) n + -nu'Iu \ > e ] = o(exp{- 
\ueu n 2 j J 



-cnb 2 n }) (3.2) 



where U n is a fairly broad set of parameters. Therefore, the main problem is how to 
narrow down the set U n . 

The following two facts have allowed to solve this problem. 

The normalized values of posterior Bayes risks tend to a constant in probability. 

In the zone of moderate deviation probabilities the normal approximation [U [21] 
holds for the sets of events ip n G n 1//2 r ni where the domain T ni has a diameter 

V!- 

Thus we can find the asymptotic of posterior Bayes risk independently for each 
an event ip n G n 1//2 r n j , sum over i and get the lower bound. Fixing the set T n i allows 
to replace the proof of (13. 2p with 



P ^sup jj^&O) - n^ 2 u'I 1/2 ^J n + ^nu'Iu, J > e, ^ n G n 1/2 T ni , A lr )j 

= .}} "exp { -,72}^ 
VAi/2r ni / 



(3.3) 



where P(A ln ) = 1 + o(l). 
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To narrow down the sets U n we define the lattice A n in the cube K Vn , v n = 
Cb n and split A n into subsets A ni i e . The set A ni i e is the lattice in the union of a 
finite number of very narrow parallelepipeds K ni j whose orientation is given by the 
position of the set T n i relative to 8q. The problem of Bayes risk minimization is 
solved independently for each set A n u e and the results are added. 

Note that the proof of (13. 3p with U n = A n u e is based on the "chaining method "together 
with the inequality 



(3.4) 




1 

- (02 ~ 6i)' T ^ + 2 n ^ 2 ~ dl)l1 ^ 2 ~ 9l) > e ' 

8=1 

G n l l 2 T ni , A ln ) < C\9 2 - 9 x \ 2 b n [ ex P {-x 2 /2}dx. 



To prove (I3.4|) we implement simultaneously the Chebyshev inequality to the first 
sum in the left-hand side of (13. 4p and theorem on large deviation probabilities for ip n . 
Thus we prove some anisotropic version of theorem on large deviation probabilities 
(see Theorem 14. 2p . 

Denote v n = Cb n . Define a sequence 5\ n = Ci n (n6 n ) _1 , with C\ n — > 0, c^nb 2 l hX — > 
as n — > oo. In the cube K Vn = [— v n ,v n ] we define a lattice A n = {h : h = 
(jiS ln , . . .JdSin), -In < jk <L = [v n /6 ln ], 1 < k < d}. Thus l n x c^nb n . 

We split the cube K KVn , < k < 1 on the small cubes T ni = x n i+(—C2 n 8i n , C2 n 8in] d , 
where C2 n — > oo,C2 n Si n = o{n~ 1 b~ 1 ), C2 n c^fn6^ +A — > as n - t-oo,1<z< m n = 
[(KC 2n Cc ln ) d n d b 2 f],x n i G K Vn . 

Suppose C is chosen so that b n Q C K(i- K ) Vn . 

For each x n i, 1 < i < m n we define the partition of the cube K Vn on the subsets 
K n ij = K(9 n ij) = {x : x = Xx n i + u + 9 n ij, u = {w/c} fc=1 , 

u±x ni , \u k \ < c 3n 5i n , A G R 1 , u G n K Vn , 1 <j < mini, 

where c 3n /c 2 „ ->■ oo, c 3n 5i„ = o(n~ 1 6^ 1 ), C3 n c]" r fr;,6^ +A ->■ as n ->■ oo. 

Let us fix z. Suppose x n j is parallel to ei = (1,0,..., 0)'. This does not cause 
serious differences in the reasoning. Denote Hi the subspace orthogonal to ej. Suppose 
the points 6 ni j, 1 < j < m lni are chosen so that they form a lattice in Hi n -fQ„. 
Define the sets 

A„(6» nii ) = K(0 nij ) n A„, 1 < j < mi„i, ni = {6» : = 6» nij , 1 < j < m lni }. 
The risk asymptotic is defined by the set 

M = {x : \x\ = inf lyl, iGffl}. (3.5) 

We begin with the proof of Theorem 12. II for the two-point case M = {—y, y}, y G dQ. 
For arbitrary geometry of the set M we are compelled to make use of a rather 
cumbersome constructions. At the same time the basic part of the proof is the 
same. 

Let 6 n ij be such that b n y G K(8 n ij ) Then — b n y G K(—9 n ij ). Let us split n j 
on the subsets 

G;(£;i, . . . , kd-di) = {9:9 = 9 nijo + (-l) t2 2k 2 c 3n 5i n e2 
+ ... + {-l) td 2k d c 3 Ji n e d - t 2 ,...t d = ±l} 
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where < hi, ■ ■ ■ , kd < C\ n with C\ n c^ n c\ n — > oo, nCl n c\ n c\ n b 2 ^ rX — > as n — )■ oo. 
Denote 

K ni {k u . . . , = U ee @ 1 ( kl ,...,k d _ 1 )K{9). (3.7) 

It will be convenient to number the sets K ni (ki, . . . , k d _ dl ) denoting their K n n, . . . , K nim2ni . 
Denote 

@rae = @ni ^ K n i e , A n j e = -^nie H A n , 1^6^ °^2ni- (3-8) 

Thus O n j e contains A; = 2 d ~ 1 points, that is, G n j e = {^}^ =1 . 

In this notation the problem of risk minimization on A n is reduced to the same 
problems on the subsets A nie 



(3.9) 



inf sup Pe(O n — 9 £ b n Q) 

L 8&K Vn 

rrin 

> inf (2l n )- d Pe ^ n ~ 9 $ ^ G nl/2T m) 

6n i=l 6»GA„ 

> (2Q~ d J2Yl inf S Pe ^« - 6 $ Kn ^ n e nl/2v ni)- 

i=l e=l 9n G A nle 

Thus we can minimize the Bayes risk on each subset A nie independently and make 
use of the own linear approximation (13. ip of logarithms of likelihood ratio on each 
set U n A n j e . 

For the arbitrary geometry of the set M the additional summation over index 
1, 1 < I < caused the different points of M arises in ( 13. 9p . Thus the right-hand 
side of ( 13. 9 P is the following 

m n m 3ni rn 2n u 

(2l n )- d J2J2 E inf E P ^ ~ 6 $ bnQ >^ G ^ 2 T ni ). (3.10) 
i=l 1=1 e=l dn eeA nile 

The definition of the sets A n u e is akin to A n j e . The statement (13. 9p with the right- 
hand side (I3.10P is the basic difference of the proof for the arbitrary geometry of M. 
For the completeness of the proof we shall write the index I in the further reasoning. 
This index should be omitted for the two-point case. 

The plan of the further proof is the following. First the basic reasoning will be 
given. After that we define the partitions of A n on the sets A n u e for the arbitrary 
geometry of M. The basic reasoning is given on the set of events Ai n such that 

P(A ln ) = l + 0(nb 2 n +x ). (3.11) 

The definition of the set A\ n is rather cumbersome. To simplify the understanding 
of the proof we have postponed the definition of the set A\ n to the end of section. 
For each 9 e A n u e denote 



s n g = Y J UQ)-6'Y. T s +2n p 2 ^ { 



s=l s=l 

and define the events 



B n e — {Xi, . . . , X n : S n e > ei n } 
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where e\ n — > 0, e l 2 c l ^nb 2 ^ x — > as n — )■ oo. 

Denote B nile = U eeAnUe B nd . For any 9 nij G Q nUe denote B ni (9 nij ) = U e€A ^ nij) B ne . 
We have 

inf Pe{e n -eibAi, n en l ' 2 T ni ) 

0eA nile 

>inf E x(0 n -0 £ Ml) exp i^f s (0)l ,^e« 1/2 r m ,A 



9eA ni i e 



In 



. s=l 



> E 



OeA-niU I S=l J 



(3.12) 



^ n G n 1/2 r ni ,A n ^ e |A ln ] P(A ln ) = R n . 

Denote A n = exp{ip' n ip n /2}, y = ye = n 1 ^ 2 9 — ip n . Then, using nb n 5 n — >■ 0, n6 2+A — >■ 
as n oo, we get 



A n inf x(t-yo-iJ>n ^ n 1/2 b n Q)exp l-^y' 9 Iy e \ , 



(2l n )~ d R n > (2l n y d E 

^en^Aflel^ln] (1 + 0(1)) 

/ ^ 7i 1/2 &n^)expj-Jy7yl dy, 

\A ln }] (1 + o(l)) = (2u n )~ d Wl + o(l)). 



(2^)- d E 



A n inf 



(3.13) 



For each k G (0, 1) denote 

K niK {9 nij ) = {x : x = Xx ni + u + 9 nij , u = {u k } d , \u k \ < (c 3n - Cc 2n )Sin, 

u±x ni , A G R 1 } n X(i_ K) „ n , 

Knilen = Uo € ® nile K niK (9) . 

If V» n e n l/2 T ni C X K „ n , then n l/2 K nUeK C n 1/2 K nile - if) n and therefore 

4i*e > t/'mie^niie(l + o(l)) (3.14) 

with 



(*) = ^f / 

* Jn 



X(t~vi n l/2 b n 9) exp \ --y'ly \ dy. 



Lemma 3.1 



(3.15) 
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Summing over I and e, by (13. 15ft . we get 

m 3ni m 2nil 

E J ™ 1 ™ ^ p (i 1/2 (0oK i n^ 2 b n n)(i + o(l)) 

1=1 e=l 

We have 

Unile = E [A n ,^n € T2 1/2 r ni | A in ] 

— E [A n ,1p n G n 1//2 r ni , £> n j/ e |74i n ] = U\ n i — U2nile- 

Lemma 3.2 For all i,l < i < m n 

C/i^ = mes(r„j)(l + o(l)), 
^2m!e = o(mes(T ni )) 

as n — > 00. 

Summing over i, by Lemma [3. 2 [ we get 

E ^ > mes(K ra J(l + o(l)) = {2Kv n ) d {\ + o(l)) 
i=i 

By (I3.16|3.20p . we get 

HzZH JntieJJmle > {2KV n ) d P{I^ 2 (0 O )C £ ™ 1/2 &r^)(l + o(l)). (3.21) 
i=l 1=1 e=l 

Since k, < /c < 1, is arbitrary, (13.91) . (I3.12p - (l3.14p . (l3.2ip together imply Theorem 
EU 

For the arbitrary geometry of the set M the reasoning is the following. Let us 
allocate in M connectivity components Mi, . . . , M S1 having the greatest dimension. 
These components define the asymptotic of lower bound of risks. Denote M = 
\J*L-]_Mi. Define the linear manifold N having the smallest dimension d\ such that 
M C N. Define in R d the coordinate system, such that N is induced the first d\ 
coordinates. Denote e±, . . . , the vectors of the coordinate system. 

Denote y nij = y(6 nij ) = {x : x = Xx ni + 9 nij , A > 0} fl b n dQ, 1 < j < m mj Define 
the sets Y ni = {y : y = y ni j, 1 < j < m lni }. We allocate in Y ni the subset Y ni of all 
points y ni j such that K(8 n ij) D b n M is not empty. 

For each y n ij G Y n i we set z n ij G b n M such that 

\Vnij Znij\ inf |j/nij z\- (3.22) 

zeb n M 

Define the set Z ni = {z : z = z ni j,y ni j G Y ni }. Denote m ini the number of points of 
7 

We split Z ni on subsets of points Z ni i = {z n m, . . . , z^i^}, 1 < I < m^ n i such that 
the vectors z n m, . . . , z n iu x induce N. Note that t < d\ points could not enter in these 
partitions since may not be a multiple of d\. However their exception is not 
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(3.16) 



(3.17) 



(3.18) 
(3.19) 



(3.20) 



essential for the further reasoning. Moreover, for the existence of such a partition 
we may have to define different constants c 3n in the definition of different sets K ni j. 
However, this does not affect significantly on the subsequent proof and we omit the 
reasoning. 

For each z ni ie_ define the point y ni ie,yniie € Y ni such that \y nile - z nae \ < c 3n 5 ln . 

For each set Z nil = {z nhjl , z nidijdi } = {z ni n, z ni i dl } we make the following. 
For each point 9 n i s j s ,l < s < di we draw the linear manifold Li s j s = {z : z = 
Oni a j s + Aie dl+ i + . . . + Xd-d^d, Ai, . . . , Ad-dj G R 1 }. We split Q ni n L isjs on the 
subsets 

® isjs (h, fcd-dx) = : = #ni s j s + (-l)* 1 2A;iC3n5ined 1 +i , s 

+ ... + (-l)' d ^i2A; d _ dl C3 n 5i n ed; ti, . . . t d _ dl = ±1} 

where < /ci, . . . , k d ~d 1 < C ln with C ln c 3n ci n -» oo, ™&^ +A Cf n c| n c? n -» as ra -)> oo. 
Denote 

Ki sjs {k u fcd-dj = U ee e is3s(fcli ... ifcd _ di)J Fr(fl). 

Denote m 2ni i{i s , j s ) the number of sets K isjs {h, . . . , ^d-rfj- 

Without loss of generality we can assume that m^nuiii, ji) — ^2^1(^2, j 2) — ■ ■ ■ — 
n r i2nii('id, jd) = ™2nii-i 1 < ^ < ^3m- This can always be achieved by making different 
constants c 3n defining the sets K n ij. Denote 

K nU (ki, . • • , fcd-di) = utLiK isjs (ki, . . • , fcd-di)- (3.24) 

It will be convenient to number the sets K n n(ki, . . . , &d-di) denoting their K n m, . . . , K ni i m2 
Denote 

Q nile = ^ni ^ K nii e , A ni i e = K ni i e fl A n , 1 < e < m 2 niZ- (3.25) 

Thus Qniie contains d\2 d ~ dl points, that is, Q n u e = {9 s j} gZi^uk = 2 d ~ dl . 

The further proof of Theorem 12.11 follows to the reasoning for the two-point 
{y, —y} geometry of set M given above. 

Now the definition of the set A\ n = A\ n n e and the complementary set B\ n = 
Biniie = D n u e UB 4ni i e \JB 3n u e will be given. The definitions of the sets D ni i e , B Anile , B 3niie 
are given bellow. 

For all s,l < s < n, denote D ns (6 nij ) = {X s : f(X„0) ^ 0,f(X s ,9) = 0,6^ 
0,6 G A n (9 nij } , D n (9 nij ) = U™ =1 D ns (9 ni j), D nile = Ue e @ nile D n (9). 

Now we define the set B 2n ue C B An u e . For any 61,62 G denote r] s (9i,9 2 ) — 
g(X s , 61,62) with 1 < s < n. Define the sets of events B2 S {6\, 62) = {X s : \t] s (9i, ^2) | > 
e}, B 2 s(6 2 ) = B 2s (0, 62) with < e < |. 

For any 6 G Q nile denote B 2nis (6) = \J e , &Kn{e) B 2s {9') , B 2ni (6) = U" =1 5 2nis (#). 
Denote -B 2n y es = Ug e Q nile B 2nis {9), B 2 nUe = U" =1 S 2n ^ es . 

The estimates of P{B 2n ue) are based on the "chaining method". For simplicity 
we suppose that l n = 2 m . This does not cause serious differences in the reasoning. 
For each 9 G Q n ue we define the sets \F,- = tyj(6),l < j < m of points ft^ = 
+ k5\ n ei,hk G A n ^ e , such that \k\ is divisible by 2 m_J and is not divisible by 
2 m -i +1 ,-l ln < k < l ln . Denote $ m+1 = # OT+ i(0) = A n (0) \ Uf =1 ^ k {9). Denote 
^o(^) — {6o}- We say that the points h G tyj and hi G are neighbors if hi is 

the nearest point of ^-1 for h. For any h G ^ we denote 11(h) = {hi : hi G 
and h, hi— are neighbors }. 
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For any 9 G Q n ue for each h G ^fj(9), 2 < j < m + 1, and all s, 1 < s < n define 
the events 

1 J 

V hs (0) = {X, : h)\ > tj-\ Vs(0, hi) + 1 > - - eJ2 k' 2 , hi G U(h)}. 

Denote 

Bi n is{9) = B 2s {9) U U2<j<m+1 ^he9j(6) Vhs{9), B ini i es = U0,z@ n . le B4 n i s (9) 

and B Aniie = \J n s=l B inaes {9) . It is clear that B 2nis {9) C B Anis (9). 
Lemma 3.3 

P(B 2nile U D nile ) < P(B 4nile U D nile ) = oil). (3.26) 

Define the event B 3ns = {X s : \r s \ > ev^ 1 }. For any 9 G Q n Ue for each h G 
^i(^)? 1 < J < m + 1, and all s, 1 < s < n define the events 

B 3nhs = {X s :\r sh -r s \>eb- 1 2 j / 2 }. 

Denote 

Bznis{9) = B 3ns U U2<j< m +i Uhe^j(e) B^s^), B 3ni i es = Uo € Q n . le B 3nis (9). 
and B 3nite (9) = U r s l =1 B 3ni i es 
Lemma 3.4 

P(B 3rdle DA 4nile ) = o(l). (3.27) 
For any 9 G e nUe denote B lns {9) = B 4ns {9) U B 3ns {9) U £^(0). Denote B ln {9) = 

By Lemmas 13.31 and 13. 44 we get (13. lip . 



4 Proofs of Lemmas cLl and 3.2 



We begin with the proof of Lemma [3721 The proof of (" 13 . 1 8[) is based on some version 
of Osypov-van Bahr Theorems |U ETJ on large deviation probabilities. 

Let Z be random vector in R d such that E[Z] = 0, Var(Z) = /, where I is unit 
matrix. Let P{\Z\ < eb^ 1 ) = 1, where e > as n — > oo. Suppose E\Z\ 2+X < C < oo. 
Let Zi, . . . , Z n be independent copies of Z. Denote S n = rT l ' 2 {Zi + ... + Z n ). 

Denote fi n the probability measure of Gaussian random vector ( with E[Q = 
and covariance matrix nl. For any Borel set W denote Wg 5- vicinity of W, 5 > 0. 

Theorem 4.1 Let the set W belong to a ball in R d having the radius r = o(e„n 1//2 6 n ) 
where e n ->• as n — >■ 0. Let nb\ oo,n6 2+A -» as n oo. Let W = Wi \ W 2 
where Wi,W 2 are the convex sets. Then 

P(S n G W) = fx n (W)(l + 0(b x )) + 0(b x n )fi n (W Cn ) (4.1) 

where c n = o(n _1 / 2 6 A_1 ). 
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The differences in the statements of Theorem 14 . 1 1 and Osypov - van Bahr Theorem 
[4"t |2"T] are caused the differences in the assumptions. In [4, 21J the results have been 
proved if -E[exp{c|Z|}] < oo. 

Let us check up that the assumptions of Theorem 14.11 are fulfilled for the random 
vector Z = I' 1 ' 2 (9 )r X (A lnl ) . 

Lemma 4.1 

£[r,A lnl ] = 0(e A ), (4.2) 
E[rr',A lnl ] = I(9 ) + O(b x n ). (4.3) 
Lemma [4.11 and Theorem 14.11 imply f)3.18p . 
Lemma 4.2 Uniformly in 9 G A n u e 

E e [S ne \A ln } = o(l). (4.4) 

Let 6i n be such that 

sup \E[S ne \A ln ]< € -^. (4.5) 
Let h e^j,hi G 11(h), 2 < j < m + 1. We have 

Sn/i — ^['S'nhl^ln] = 'S'n/ii + ^lra/i + ^2nh ~ E\S n h x + Si n /j + S 2 nh\Ai n ] (4.6) 



where 



Smh = J^Uhuh) - h'J2^ hl , (4.7) 

s=l s=l 

n 

S 2 nh = h'J2(Ts hl -T s ) (4.8) 



with h = h — hi. 
Denote 



B 0n = {Xi, ...,X n : sup S nh > e ln /4}. 
For any h G ^j, 2 < j < m + 1 denote 

-£>5ra/i — {-^1) • • • j X n : j 2 (Si n h — E[Si n h\A ln ]) > 6 lrl /4}, 
-B6n/i = {^1, • • • , X n : j 2 (S 2n h ~ E[S 2n h\A ln ]) > 6 ln /4}. 

Denote 5„ = B 0n U (U 9eAni;(! \*i ( 5 5n0 U ^enfl))- Note that B n D B nile . Hence 

U 2n ue < U 3nile = E [A n , i) n G n 1/2 T nh B n \A ln ] . (4.9) 
Denote r ni = inf xe r n . \x\. We have 

Usnile < C exp{nr 2 ni /2} ( V 0n + ^ (V 5n6 + V 6n6 ) J (4.10) 

where Ai niZe = A niie \ 6 niZe , 

Kne = P (V« e ^ 1/2 r™, I A ln ) , e = 5, 6, (4.11) 
= P(^£ n 1/2 r ni , ^ | Ai„) . (4.12) 
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Lemma 4.3 Let ( Gaussian random vector having the covariance matrix I(9q) and 
let E[() = 0. Then for any h G h x G 11(h) 

Von < Cnb 2 + x e^P{C G n l ^ 2 T m ), (4.13) 

V 5nh < Cn\h\ 2 b x e^j 4 P(( e n x / 2 r ni ), (4.14) 

< C^l^e^'MC e ^ 1/2 r m ). (4.15) 

The number of points V&j, 1 < j < m, equals 2- 7 and, if h G then h = 6 n 2~ J . 
The number of points ^ m +\ equals Ccf~ 1 2 m and, if h G \I/ m +i, then < Cc3 n 5i„. 
Hence, by Lemma [4.31 we get 

U 3nile < Cne^ exp{nr 2 ni /2}P(( G n 1/2 r ni ) 

(4.16) 



x 



Note that m satisfies 5i„ = v n 2 m or 2 m = Cc-^nfr 2 (1 + o(l)). Hence 

(4.17) 

By (PlIiTT) . we get 

Uzniie = o(mes(T ni )). (4.18) 

By gSD and (Qgj) . we get fl3~T^|) . 

Proof of Lemma 14.31 is based on Theorem 14.21 

Theorem 4.2 Let we be given a random vector V = (X, Z) where random variable 
X and random vector Z = (Z 1; . . . , Z&) are such that E[V] =0. Let 

P{\X\ < e) = 1, E[\X\ 2 ] < Cb 2 n + \ (4.19) 

P(\Z\ < eb- 1 ) = 1, E[\Z\ 2+X ] < C < oo, (4.20) 

E[XZ k ] = 0(^ +A ), l<k<d (4.21) 

with < e < 1. Suppose the covariance matrix of random vector Z is positively 
definite. 

Let V\ = (Xi, Zi), . . . , V n = (X n , Z n ) be independent copies of random vector V . 
Let U be a bounded set in R d being a difference of two convex sets. 

Denote S nX = n~ 1/2 (X 1 + . . .+ X n ) and S n = n~ 1/2 (Z 1 + . . . + Z n ). Denote Y the 
Gaussian random vector having the same covariance matrix as the random vector 
Z. 

Then, for the sufficiently large n, 
I = P{S nX > e ln , S n G nb n v + r n U) < CP{S nX > t ln )P{Y G nb n v + r n U) (4.22) 
where ei n ,r n are chosen so that nb 2 ^ x c~^e^ 2 — > as n — >■ oo and r n > c n \n~ l / 2 b~ 1 . 
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It is clear that ei n ,r n can be chosen such that E\ n — > 0, r n n l l 2 b n — > as n — > oo. In 
the proof of (I4.14|l4.15p we suppose that e\ n and r n satisfy these assumptions. 
For the estimates of V^ n h in (I4.14p we implement Theorem 14.21 with Z = t and 



X = ip(h u h) = ({hi, h) - h'r hl - ^ Pkh x 



hTk- 



k=l 



Here r = {r k }f =1 and p hlh = {pkh x h\k=i = r hlh (E[rr'\A lnl ]) 1 with r hl h = {rkh x h)k=n r kh 1 h 
E[{Z{h u h) -h f r hl )r k \A lnl ]. 
Thus Si n h is replaced with 



n d 



PkhihTks = y^^sjh, h). 



=1 k=l s=l 



It is easy to see that E[(p(hi, h)Tj,\Ai n i] = 0, 1 < k < d. This implies (I4.2ip . 
Now we show that 



n d 



z ^ z ^pkh 1 hT k s = o{l) (4.23) 



s=l k=l 



if i/j n E n l l 2 Y n i This justifies such a replacement. 

By Lemma 14.41 given bellow, jr^^l < C\h\ 1+X ^ 2 , if 2 < k < d. Hence, since 
ip n E n^Tni, 

n 

r khlhz Z^ = Oifhl^X 1 ) = o(l) (4.24) 

s=l 

with 2<k<d. 

Lemma 4.4 Let h E ^j(0), 1 < j < m + 1, hi E 11(h) and let v ± h, u E R d . Then 
E[(ahi, h) - h'r hl )(v'r), A lnX \ = 0(\v\ \h\ 1+x/2 ). (4.25) 
By Lemma [4.51 given bellow (ri^^l < C\h\b x . Hence, since ip n E ra 1 / 2 r n j, 

n 

n hlh ru = 0(n\h\b n +x ) = o(l). (4.26) 

s=l 

By dH, (M, <gM, we get g33J- 

Lemma 4.5 Let h E ^j(0), 1 < j < m + 1, hi E 11(h) and let v \\ h. Then 

E[(ah 1 ,h)-h / r hl )(v'r),A lnl ]=0(\v\\h\b x n ). (4.27) 

Note that 

2r](hi, h) - 2r t 2 (h 1 , h) < ((hi, h) < 2r](h u h) < 2e (4.28) 

if Aini holds. 

By (I4.28P and Lemma H~6l given bellow, we get (I4.19p . 
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Lemma 4.6 For all 6 £ A ni i e 

E[(m-0'r) 2 ,A lnl ]=O(\9\ 2+X )- (4-29) 

Let h £ Vj(9), 1 < j < m + 1 « /ii £ 11(A). T/ien 

£[(£(/*!, ft) - frV.J 2 , A lnl ] = 0(|/i| 2+A ). (4.30) 

This completes the proof of (I4.14|) . 

The proof of ( I4.13P is akin to the proof of (I4.14p and is omitted. 
For the estimates of V§ n h in (I4.15P we choose Z = r and 

d 

X = h'(r hl - t) - 22 PkhihTk- 
k=i 

Here r = {r k }f =1 and p khlh = {pkhih}k=i = f hlh (E[TT'\A lnl }y l with f hlh = 
{r k hih}k=i^khih = E[h'(r hl - r)T k \A lnl ], 1 < k < d. 

Using the same reasoning as in the proof of ( I4.14p and Lemmas 14. 7\ 14.81 given 
bellow we get (I4.15p . 

Lemma 4.7 Let u,h £ R d . Then 

E[(u'(t - T h ))\A lnl ] = 0(\u\ 2 \h\ x ). (4.31) 

Lemma 4.8 Let h £ *j(0), 1 < j < m + 1, h £ 11(h). Let v ±h,v £ R d . Then 

E[h\r hl - T)(v'r),A lnl ] = 0(\v\\h\\hi\ X/2 ). (4.32) 

Ifv || h, 

E[h'(r hl -r)(v'T),A lnl }=0(\v\\h\\h 1 \ x ). (4.33) 

Proof of Lemma \3.1\ The set A n u e is defined by the set of the points Q n iie = 
{9 S j} s X j=i, k = 2 d ~ dl . The reasoning first will be given for \t\ < c < oo. Denote 
n 1/2 y S j(t) £ (n 1/2 6 n <9fi - t) H (n 1/2 fT(6^)) the point in which n 1/2 y si = n 1/2 y(6 sj ) 
will pass at the shift t. Denote n 1/2 y s+duj {t) £ (n 1 / 2 ^^ - t) n (n 1/2 if(6> si )) the 
point in which w}l 2 y dl+s = —n L ^ 2 ysj will pass at the shift t. 

Lemma 4.9 There holds 

2di k , d± k , >. 

Proof of Lemma \4-9\ For a while we fix s < c?i and j. We slightly modify the 
coordinate system for the further reasoning. Suppose x n i = (1, /3 2 , • • • , P d ) and y S j = 
(b n , 0, . . . , 0, 5 dl+l , n n- l l\ . . . , cW™- 1/2 )(l + ( n -i/2 fe -i)) with 5fen e + 1 < < 

Define the line y = n l l 2 (y S j + ux n i), u £ i? 1 , that is, 

y x = n 1/2 6„ + u ,y 2 = 02U, ...,x dl = (3 dl u, 
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y dl+ i = 5 dl+lin + Pd 1+ xu, ...,y<i = 8d,n + PdU, \5kn\ < C, di + 1 < k < d,u G R 1 . 

Denote 5k n = for 1 < k < d%. 

Since the reasoning is given in a sufficiently small vicinity of point n x l 2 y S j the 
surface n}l 2 b n d^l admits the approximation in this vicinity by an ellipsoid 

(xi - n 1/2 b n ) 2 + + • • • + OL d x\ = nb 2 n 

where —0-2, • • • , — oi d are the principal curvatures of the surface dQ at the point 
(1,0, ... ,0). Thus, in the further reasoning, we can replace the set n l l 2 b n dVL with 
the ellipsoid. After the shift t — (t\, . . . ,t d ) the ellipsoid is defined by the equation 

(xi - n 1/2 b n + t{) 2 + a 2 {x 2 + h) 2 + . . . + a d (x d + t d ) 2 = nb 2 n 

and intersects the line y = n 1 / 2 ^^- + ux n i), u G -R 1 at the point r^^ygjit) having the 
coordinates 

n l ' 2 yi {t) = n l l 2 b n -h + u ln , n^ 2 y k (t) = 5 kn - 2 h + (3 2 u ln , 1< k < d. (4.35) 
with 

u ln = -(2n 1 / 2 60- 1 (a 2 (5 2n + t 2 -/3 2 t 1 ) 2 + ... + a d (5 dn + t d -/3 d t 1 ) 2 )(l + o(l)). (4.36) 

Arguing similarly we get that the ellipsoid intersects the line y = n l l 2 (—y S j + 
ux n i),u G R 1 at the point n l l 2 y s+dl j{t) having the coordinates 

n 1/2 y[(t) = -n^bn-h+u^ n^ 2 y' s {t) = -5^-/3^+^00^ 1< k < d x (4.37) 

with 

oo 2n = (2n 1 / 2 b n )-\a 2 (-6 2n +t 2 -f3 2 t 1 ) 2 + . . . + a d (-S dn +t d -(3 d t 1 ) 2 )(l+o(l)). (4.38) 
Substituting (j05l07|l in (|4H we find that, if tj. »> n -1 / 2 *)" 1 , then 
max{exp{-n( 2/l (t) 2 )/2}, exp{-n(^(t) 2 )/2}} »> exp{-« + 5 2 di+1 ...+ 5 2 d )/2}. 
Thus we can suppose t\ < cn~ l ^ 2 b~ 1 and neglect the addendums /3jti,2 < i < d in 
Using ( K35l 1437]) , we get 

exp { -\n\y sj (t)\ 2 I + exp { --n\y s+dld (t)\' 



= exp{-?% si | 2 /2} I exp < n 1/2 6 n ii + ^ a Ah 
V I k=d 1 +i 

+ exp \ -n 1/2 6 n ti - ^2 a ktk&kn \ I exp \ ~ ^ a k t\ \ 

[ k=di+l J / I fc=di+l J 



(4.39) 

l + o(l)). 
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Taking the points y S j, 1 < j < 2 d dl , with all possible values ±5 kn , d\ < k < d and 

Xp{ ^ 1 We § et 

w6 n + ^ 1+ l,n + "-<*dn' 



summing up for them exp{— ^ SJ ^ } we get 



cxp 

x 



2 

(exp{n 1/2 6 n ti} + exp{-ra 1/2 6 n ti}) (4 40 ) 

J J (exp{a k t k 5 kn } + exp{-a k t k 5 kn })(l + o(l)). 



x 

fc=tii+l 



Since exp{t>} + exp{-w} - 2 > with v E R 1 , then ( TOOl) implies ([04]) for |t| < C. 

In essence, we have considered only the case u = 0. Any point y u = n l l 2 (y S j + 
tix n i),0 < « <<< 1, pass after the shift t at the point n 1 / 2 (?/< j j(t) + ux n i) E (R d \ 
[n^^bnVt — t)) fl (n lj/2 K(9 S j)). Thus for any point y u ,0 < u «< 1 we can write a 
similar inequality (14.341) . Since the shift t is negligible, 



mes 



{{n 1/2 b n dn) n 1T(0 8 j)) = mes((n 1/2 6 n <9^ — t) fl A"(0 ai ))(l + o(l)). (4.41) 



This implies J ni ; e (i) > J n ite(0). 

Let us consider the case c << |t| << Cn 1//2 6 n . Note that, since all the principal 
curvatures in all points of dVL are negative, we can conclude n l l 2 b n Vt into an ellipsoid 

~ = {x = {xi} d i=1 :xl + ... + x 2 di + a dl+1 x 2 di+1 + ... + a d x\ = nb 2 J 

passing through the points y n u e and —y n u e , 1 < e < d\ and such that a k < l,di + 
1 < k < d. Denote y sj (t) E (n 1/2 b n dQ - t) (1 {y : y = 9 sj + E R 1 } and 

y S j(t) £ (2 — t) PI {y : y = 6^ + x n jM, tiGfl 1 } the point in which the y S j will pass at 
the shift t. 

It is easy to see 

f^ exp (_M»>f^ exp (_M*}. (4 . 42) 

s=i j=i ^ ' «=i j=i ^ ' 

For the points y S j{t) we can make estimates similar to the case \t\ < C < 00 and 
can get 

^^exp{-»r^}>^^exp{-WfL}. (4.43) 

5=1 J = l ^ "J S=l j = l ^ 

The statement (105]) implies J(t) > J(0) for c << |t| << Cn 1 / 2 6 n . 

Finally, after the shift t, \t\ x n 1//2 6 n one of the points y n a e or —y n u e , 1 < e < di 
will be located at a distance having the order n x ' 2 6 n outside the ellipsoid H and 
hence outside n 1//2 fe n f2. This implies J(i) > J(0). 



5 Proofs of Theorems 4.1 and 4.2 



The proof of Theorem 14 . 1 1 cont ains only some different technical details in comparison 
with the proof of similar Theorem in |21j. The proof of Theorem 14.21 is based on a 
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fairly new analytical technique (see O [10]) and is more interesting. Thus we begin 
with the proof of Theorem 14.21 

Proof of Theorem \4 ■ H!\ We begin with auxiliary estimates of moments of random 
variable X and random vector Z. We have 

E[\X\\Z\ 2 ] < (E\X\^)^(E\Z\ 2+X )^ < C(E[X 2 ])^x < Cb x , (5.1) 

E[X 2 \Z\] < Cb- l E[X 2 ] < Cb l +\ (5.2) 

E[X 2 \Z\ 2 } < Cb- 2 E[X 2 ] < Cb x , (5.3) 

E[X 2 \Z\ 3 ] < Cb- 3 E[X 2 ] < Cb x ~\ (5.4) 

E[X 2 \Z\ 3 } < CE[\Z\ 3 } < Cb x n - l E[\Z\ 2+x ] < Cb x -\ (5.5) 

For each x = {xi, . . . ,Xd} G R d denote = max^,^ \xi\. For any z G R d and 
any A C R d denote \\A — z\\ = inf xeJ 4 \ \x — z\\. For any e > denote A e = {x : 
\\A - x\\ < e,x e R d }. 

Define twice continuously differential functions f\ n : R l — > R 1 such that 



hn{x) 



1 if \x\ > e ln 
if \x\ < e ln /2 



and < f ln (x) < 1, < Cejl l<h,i2<d,xe R d . 

Denote c n = c n i r n~ 1 / 2 b~ 1 . We slightly modify the setup of Theorem 14.21 in the 
proof. The reasoning will be given with r n = 1. Theorem 14.21 follows from the 
reasoning if we put r n = c n . 

Define three- times continuously differentiable functions f 2n '■ R d — > R 1 such that 



f2n(x) 



1 if i G n x l 2 b n v + U 
if x n 1/2 b n v + U Cn 



and < f 2n (x) < 1, I g^t^tj < Cc7 n \ 1 < h,i 2 ,i 3 <d\ixeR d . 
Denote 

SknX — Xi + . . . + X k _i + X k+ i + . . . + X n , 

W kn = n- xt2 {Z x + ... + Z k ^ + Y k+1 + ... + Y n ). 

Hereafter Yi, . . . , Y n are independent copies of random vector Y. Random variables 
Y, Yi, . . . , Y n do not depend on Xi, . . . , X n , Z±, . . . , Z n . 
For any 7 > denote 

G n (j) = sup E[f ln (S nX ), S nZ e n 1/2 b n v + C 7 ] 

where the supremum is taken over all distributions of (X, Z) satisfying the assumptions 
of Theorem IP 

Lemma 5.1 Let assumptions of Theorem \4-2\ be satisfied. Then 
E[f ln (S nX ), S nZ e n l ' 2 b n v + U] 

< E[f ln (S nX )]P(Y e n^Xv + U Cn ) + Cnb 2 n +x c-fc 2 G n ^( ln ) 

forn > n . Here 7„ = eb^(n - 1)~ 1/2 + (n(n - iy 1/2 b n - (n - l) 1/2 6„_i) + C/n + c n 
where C depends on U . 
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Proof of Lemma 15.11 We have 

E[f ln (S nX )f 2n (S nZ )} < E[f ln (S nX )f 2n (Y)} + A 

where 

A = \E[f ln (S nX )f 2n (S nZ )] - E[f ln (S nX )f 2n (Y)]\. 
It is clear that A < Aj + . . . + A n where 



(5.7) 
(5.8) 



A, = |£[/i„(5 M +X,)/ 2n (^ n + n- 1 / 2 Z,)]-£[/ ln (5 M + X fc )/ 2ri (^„ + n- 1 / 2 y)]| 

(5.9) 

for 1 < k < n. 

Expanding f\ n and f 2n in the Taylor series, we get 



A fe = \E[f ln (S knX + X k )(f 2n (W kn + n- x ' 2 Z)\ - f 2n (W kn + rT^Y))]\ 



,-1/2. 



E 



< 



x n 



H — ri 



(fm(S k nx) + f[ n (S knX )X k + ^ J f" n (S knX + uX k )(l - u) dwX i 



-1/2, 



-3/2 



(Z fc - F)'/^(W fcn ) + -n-\Z' k fl{W kn )Z k - Y'fl{W kn )Y) 



(1 - uYifZiWkn + ujZ k )Z A k - fZ(W kn + ujY)Y a ) du 



(5.10) 



After opening the brackets in the right-hand side of (15.101) it remains to estimate 
each of the resulting addendums independently. The estimates are performed in the 
same way, using ( 14.191 14.201 14.211 15.11 - 15. 5j) . Therefore, we estimate only three of 
them. 

Using (I5.4p . we get 



n^ 2 E 
l 



x 



fln( S knX + wX fc )(l - U x ) du X X^ 

[\l - u)\fZ(W kn + u 2 Z k )Z 3 k - fZ(W kn + u 2 Y)Y 3 ) du 2 ] (5 - U) 
Jo J 

The first inequality in ( 15. lip is obtained on the base of the following reasoning 

W kn + n- l ' 2 Z e n x l 2 h n v + U Cn =► W kn e n l ' 2 b n v + U en - 1/2b -i +Cn 

n l / 2 (n - l)- l/2 W kn e (n - l) 1/2 b n ^v + (n(n - iy l/2 b n - (n - l) l/2 b n ^, 
+ n 1 / 2 (n-l)- 1 / 2 f7 en _ 1/26 -i +Cn 



n 



i/2(„ _ l)-^w kn e (n - l) 1/2 6„-ii; + C/ 7 „. 



Using ( 15. ip . we get 

£;[|/L(5' fe ,n-i ) x)X fe n- 1 ^ n (W fcn )Z, 2 |] 
< Cn-^c^G^Tn) < G^e^G^n). 



(5.12) 



(5.13) 



20 



Using (14.21)) . we get 

n- l / 2 E[f ln {S knX )X k {Z k - Y)f 2n {W kn )\ 

= n^ 2 E[X k Z k }E[f[ n (S knX )fUW kn )] < Cn^H^^c-lGuniln). 

This completes the proof of Lemma 15.11 

We begin the proof of Theorem 14.21 with auxilliary estimates. 

P(Y E n l ' 2 b n + U Cn )< e W {Cc n n l/2 b n }P(Y E n l / 2 b n + U) 

i /n 5.15 

< a P(Y En 1/2 b n + U). 

Note that 

Y E (n - l) 1/2 b n . lV + U ln ^Y E n l ' 2 b n v + U Un (5.16) 

with u n = 7„ + n l/2 b n - (n - l) 1/2 6„_i. 
Therefore 

P(Y E(n- If^b^v + U 7n ) < P(Y E n^v + U Un ) 
< Cexp{n 1/2 b n u n }P(Y E n 1/2 b n v + U)< ai P{Y E n 1/2 b n v + U). ' 



The further reasonings are based on an induction on n. We take a sufficiently large 
n = n such that CnQe^c^^b 2 ^^ < a with aa ai < 1. We take C no such that 

C no P(Y E n /2 b no + U)E[f ln (S noX )] > 1. (5.18) 

Then 

E[f ln (S noX ), S noZ E n\ /2 b no v + U]< C no P(Y E n /2 b no + U)E[f ln (S noX )]. (5.19) 

Suppose Theorem 14.21 was proved for n — 1 > n . Let us prove it for n. We show 

E[f ln (S nX ), S nZ E n^bnv + U}< C n P{Y E n l l 2 b n + U)E[h{S nX )\ (5.20) 

where C n = ao + C n -\aai. Then, since C n form geometric progression with exponent 
actual < 1, Theorem 14.21 follows from (15. 20 p . 

Applying (15. 6p and the inductive assumption , we get 

E[f ln (S nX ), S nZ E n 1/2 b n v + U}< P(Y E n l ' 2 b n + U c jE[f ln (S nX )\ 

+ Cnb 2 n +x c-^ 2 C n ^E[f ln (S nX )}P(Y E(n- l) 1/2 b n ^ + U ln ) (5.21) 

< (ao + C n . 1 aa 1 )E[f ln (S nX )]P(Y E n l / 2 b n + U). 

This implies Theorem 14.21 

Proof of Theorem \4-l\ In the proofs of Theorem 14.11 and Osypov Theorem j21] 
the basic reasonings coinside. The difference is only in the preliminary estimates. 
On these estimates the basic reasoning are based on. 

Denote <p{h) = E[exp{h'X}]. Define random vector having the conjugate 
distribution 

F h (dx) = F(dx,h) = ^(h) exp{h'x}F(dx). 

Denote 

m(h) = E h [X h ], a(h)=V a r[X h }. 
For any v E R d denote h{v) the solution of the equation 

m{h) = v. (5.22) 
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Lemma 5.2 For all v, \v\ < eb n ,e > there exists the solution h(v) of equation 
and 

m = l + \h\ 2 /2 + 0(\h\%^ 1 ), (5.23) 

m(h) = h + 0(\h\X- 1 ), (5.24) 

^(t,) = v + OdvlX- 1 ), (5.25) 

a(/.) = /(l + 0(|/.| 2 ^- 1 )). (5.26) 



Proof of Lemma I5.M Expanding in the Taylor series we get 

4(h) = 1 + \ J (h'x) 2 dF(x) +o(\h\ 3 J\x\ 3 dF(x)^j = 1 + \\h\ 2 + 0(\h\X-% 

(5.27) 

^ m -m2 + o W (5 ' 28) 

/i + od^ + i^- 1 )- 



Substituting (15T281) in (15T221) . we get (15T25D . Estimating similarly to (15T281) . we get 
(E26]). 
Denote 

A(h,v) = -(h,v) + In ^(h). 

By (15.2305.251) . we get 

1 



(5.29) 



ln0(%)) = -/r^l + O(^)). 



By (I5^6|) . we get 



det-^ 2 a(h(v)) = 1 + 0(0- 



By (1535)1 and (jOQD we get 



1 



A(h(v),v) = \v\ 2 (l + 0(\v\b^)) - -\v\ 2 (l + O(O) 



(5.30) 
(5.31) 

(5.32) 



-M 2 + 0(M a & 



The estimates fl5.23H5.26j) and (I5.301|5T32|) are the versions of similar estimates in 
[21] . Using these estimates we get Theorem 14.11 on the base of the same reasoning 
as in [21]. This reasoning is omitted 



6 Proofs of Lemmas [3^UX4ll4J]J4^1 and [47414478 



The Lemmas will be proved in the following order: | 

Proof of Lemma\tM Let h G *,-(0) and h± E 11(h). By (J2HD and (£3]), we get 

P hl (\v(hi,h)\ > e) < P^dnfah) - h'r hl \ > e/2) + P hl (\h'r hl \ > e/2) 

2 (6.1) 
< 4e- 2 £U(^i^) " ^J 2 ] + 2 2+ V 2 - A |/.| 2+A ^ 1 |r, 1 | 2+A < C\h\ 2+ \ 
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By straightforward calculations, using (16. ip . for 1 < j < m, we get 

P(V h (9)) < CP hl Mh,h)\ > ej- 2 ) < Ce-Y\h\ 2+X < Cj 4 (|) 2+A - (6.2) 

In the case of j — m+ 1 the constant C in (16. 2p is replaced with Ccg" 1 . By (16. 2p . 
we get 

— (h \ 2+A 

P{B, n {9)) <CfcJ> | f + Cn4-W 3 ^ X m'. (6.3) 
Note that 2 m = Cc^nfr 2 (1 + o(l)) . Therefore, using n~ x b~ x < nb 2+x , we get 



P{B in {6)) < Cnb 2 n +X + C^+ 1+A 2- m ( 1+A Wfe 2+A 
< Cnb 2 n +x e- 2 - x + C^c^+^-^m 4 = 0(nfe 2+A ) = o(l) 

if C3„ tends to infinity sufficiently slowly. 

Since P$ n (S) < C\h\ 2+X , then, arguing similarly (Q-fOJ, we S et 

m+l 

P(D nUe )<CnJ2 E ^1^) 
i=i he*j(e) 

m 

< Cn^ 2 J (6 n 2- J ') 2+A + Cnc^ 1+A 2 m 5 2 + A = o(l). 



(6.4) 



(6.5) 



Now (I6.4|6.5p implies ( I3.26p . 

Proof of Lemma \3.4\ Applying the Chebyshev inequality and using (12.31) , we get 

P(B 3nl ) < e- 2 - x b 2 n +x E[\r\ 2+x ] < Cb 2 n +X . (6.6) 

Let h £ ^/j(6), 1 < j < m+l. By Chebyshev inequality, we get 

P(\r sh - r s \ > eb-^' 2 \A inl ) < C2-^ 2 + A )/ 2 6 2 + A e- 2 - A (£;[|r ft | 2+A |A 4nl ] + E[\r\ 2+X ]) 
< C2-^ 2+A )/ 2 6 2+A e- 2 - A (^[|r h | 2+A ] + E[\r\ 2+X ]) < C2-^ 2+x V 2 b 2 n +x . 

(6.7) 

By dSSP, dS3D, we get 

771 

P(B 3mle ) <CnJ2 2^ 2+A 2-^ 2+A )/ 2 + Cnc^ 1 2 m 2- m ( 2+A )/ 2 6 2+A < Cnb 2 n +X = o(l). 

3=1 

(6.8) 

By dS3J,dSSP and (Q, we get 

P(£? lm z e ) < Cn6 2+A . (6.9) 
Proof of Lemma \4-1\ Since £7[t] = 0, we have 
|£[r,A lnl ]| = |£[r,fl lfll ]| 

<S[|r|,|r| >&- 1 ]+£[|r|,B lnl n{|r| < 6; 1 })] (6.10) 
<b)+ x E\T\ 2+x + b- l P{B lnl ) = 0(bl +x ) 
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where the last equality follows from fl2.3p . fl6.4p . fl6.6p . 
The proof of ( 14. 3 p is similar and is omitted. 

The considerable part of the subsequent estimates is based on the following 
lemma. 

Lemma 6.1 Let h G tyj(9),hi E 11(h), 1 < j < m + 1,8 e ® n ue- Then, for any 
a > 0,6 > 0, a + b > 2 + A, there holds 

E hl [\hr hl \ a \v(hi,h)\ b ,A lnl ) < C\h\ 2+X . (6.11) 

Proof of Lemma 16.11 By (12. ip and (12.31 we get 



E hl [\hr hl \ a \v(h,h)\ b ,A lnl } < C E hl [\hr hl \ a+ \ A lnl ] + CE hl [\ri{h u h)\ a+ \A lnl ] 

< CE hl [\hr hl \ a+b ,A lnl ] + CE hl [\v(h,h) - hr hl \ a+b , A lnl ] 

< CE h A\hr h A 2+ \A lnl ] + CE h A\ V (h 1 ,h)-hr h A^A lnl ] < C\h\ 2+X . 



(6.12) 

Proof of Lemma \4-2\ Expanding in the Taylor series, we get 

n n 9 n 3 ( n\ 

s ne = J2(2 Vns (0) - e'r s ) - J2 vl(o) + o £ n + Z im + 2V(0 ' d) (eu3) 

where < K < 1. 

Since #[t£(0)] = p 2 (0,6) and 2£[r? n (#)] = -£7[»£(0)] = ~p 2 (0,6), by virtue of 
flZD, we get 

£[(2^(0) - 9'r) - rf ns {9) + ~0'/0] = O(|0| 2 + A ). (6.14) 
By (I6.406.9p . we get 

E[\rj n (9)\, B lnl ) < E[\ Vn (9)\, \rj n (9)\ > e] + E[\ Vn (9)\, B lnl \ {\rj n (9)\ < e}] 
< > c] +eP(B lnl ) < E[\ Vn (6)\, \ Vn (9)\ > e]+Cb 2 n +x . [ * > '" >] 

By (J2UE3D, we get 

E[\ Vn (9)\,\ Vn (9)\>e] 

< E[\ Vn (6)\, \ Vn (9)\ > e , \ Vn (9) - \&r\ < e/2] + E[\ Vn (9)\, \ Vn (9)\ > e, \9r\ < e/2] 

< CE[\9'r\, \ Vn (9)\ > e, \ Vn (9) - l -6'r\ < e/2] + Ae~ l E[{r, n {e) - \&r) 2 \ 

< Ce-^EHe'rl 2 ^] + Cb 2 n +X < Cb 2 n +X . 

(6.16) 

By (JS35D and f l6TT6|) . we get 

E[ Vn (9)\B lnl )<Cbl + \ (6.17) 
Arguing similarly to (16.151 16.16p . we get 

E[r, 2 n (6),B lnl } = 0(b 2 + x ). (6.18) 
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By fl6.1406.906.10ll6Tn) .f lO8|) . we get 



E[(2 Vn (9) - -9'r) - v 2 ns (6) + -6' Id, B lnl ] = 0(\b n \ 2+x ) 



(6.19) 



By Lemma 16. 1[ we get 



E 



(1 + K Vn {9)f 



A 



lnl 



<CE[\rf n {9)iA lnl ]<C\e\ 



2+A 



By (|533}, (1531), (1532}, (lO^ we get (JO}. 
Proof of Lemma |^.6| Using ( 16. 1 3[) , we get 



(6.20) 



E[W) ~ d'rY,A lnl ] < CE[( Vn (6) - -9'r 
+ CE[r 1 *(e),A lnl ]+CE[r ] i(9),A lnl ]. 



By Lemma [6.11 we get 
and 



E[4(6),A lnl } = 0(\6\ 



E[r] e n (9),A lnl } = 0(\9\ 



2+A\ 



2+A\ 



(6.21) 

(6.22) 
(6.23) 



By (J23}, ([621]), (E22J), §M> we get ((OS]). 
Estimating similarly to (I6.21H6.23]) . we get 

E[(ah,h)-h'T hl ) 2 ,A lnl ] 

< CE hl [(£(hi,h) - h'r hl ) 2 ,A lnl ] < C\h\ 2+ \ 

This implies (I4.30p . 

Proof of Lemma \4-4\ Applying the Cauchy inequality, by (14.311) , we get 

Eii^h) -h'T hl )(v'T),A lnl ] 

< {E[(Z(h, h) - h'r hl ) 2 , A lnl }) l l 2 {E[{v'r) 2 , A lnl ]) 1/2 < C\v\ \h\ l+x ' 2 . 



(6.24) 



(6.25) 



This completes the proof of Lemma 14.41 

Proof of Lemma \4-l\ Using the inequality (a + b) 2 — lb 2 < 2a 2 , putting a = 
rj(0, u) + \u'r — rj{h, h + u) + \u'Th and b = r](h, h + u) — r](0, u), we get 

E[(u'(t - r h )) 2 , A lnl ] - 2E[{r](h, h + u) - 77(0, u)) 2 , A lnl ] 

1 1 o (6-26) 

< 2E[(r){h, h + u)- -u'r h - r](0, u) + -u'r) 2 , A lnl ] = J. 

Using the inequality 2a 2 < 4(a + b) 2 + 46 2 , putting a = r](h, h + u) — \u'Th — 77(0, u) + 
\u't and b = 7/(0, u) — \u't, by (12. ip . we get 



J < AE[( V (h, h + u)- l -u'r h ) 2 , A lnl ] + 4E[{r}{0, u) - \u't) 2 , A lnl ] 



< CE h [( V (h, h + u)- ^u'T h ) 2 } + C\u\ 2+X < C\u 



1 2+A 



(6.27) 
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Thus, for the proof of (I4.3ip . it suffices to show 

J x = E[(r)(h, h + u)- r){0, u)) 2 , A lnl ] = 0(\u\ 2 \h\ x ). (6.28) 

By straightforward calculations, we get 

(r)(h,h + u) -rj(0,u)) 2 

= (77(0, h + u)- 77(0, h) - 77(0, u) - r/(0, h)r}{0, u)) 2 (r](0, h) + 1)~ 2 . 
Therefore 

J x = E[( V (0, h + u)- 77(0, h) - r/(0, u) - 77(0, /i)77(0, u)) 2 ( V (0, h) + l)" 2 , A lnl ] 

< CE[(r](0, h + u)- rj(0, h) - 7/(0, u) - r)(0, h)rj(0, u)) 2 , A lnl ] 

< CE[( V (0, h + u)- l -{h + u)'r - (77(0, h) - h'r) - (77(0, M ) - h'r)) 2 , A lftl ] 
+ C£[t7 2 (0, % 2 (0, 77)), Aim] = J11 + Ju- 

Applying (12. ip . we get 

Ju < CE[( V (0, h + u)-^(h + u)'r) 2 } + CE[{r](0, h) - h'r) 2 ] 
+ CE[( V (0, u) - h'r) 2 ] <C\h + u\ 2+x + C\h\ 2+ \ 



(6.29) 



(6.30) 



By Lemma 16.11 we get 

J12 < CE[ v \0,h),A lnl ] +CE[ v \0,u),A lnl ] < C(\u\ 2+X + \h\ 2+x ). (6.31) 
By (16T2W3T1I6T271I6T26|) . we get 

E[{u'{t - h h )) 2 , A lnl ) <C{\h + u\ 2+x + \u\ 2+x + \h\ 2+x ). (6.32) 

Putting |tj| = co\h\ and d = C((l + c ) 2+A + c 2 +x + c^Cq 2 , we get 

E[(u'(r-r h )) 2 ,A lnl ] <CM 2 \h\ X - (6.33) 

This completes the proof of Lemma 14.71 
Proof of Lemma \4-5\ Denote 

W = Eii^r)^, h) - h'r hl )\A lnl ] = E[(h[(r - T hl ))^(h h h) - h'r hl )\A lnl \ 
+ EKti^mh, h) - h'r hl )\A lnl ] = W n + W X2 . 

(6.34) 

By (10T]1 . (10D|1 . we get 

W n < (E[(h[(r - r hl )) 2 \A lnl ]Y' 2 {Emhn h) - h'r hl ) 2 \A lnl ]f' 2 
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We have 

Wt2 = E hl [(1 + V (h u 0)) 2 (/i' 1 r /ll )(e(/ii, h) - h'r hl )\A lnl ] 

= E hl [(h[r hl )(ah u h) - h'r hl )\A lnl ) + 2E hl [rj(hi,0)(ti 1 r hl )(£(h l ,h) - h'r hl )\A lnl ) 
+ E hl [rf{h u 0)(/ i , 1 r ftl )(e(/ii, h) - h'r hl )\A lnl ] = W 121 + W l22 + W 123 . 

(6.36) 

By fl6TT3|) . we get 

W 12 i = Eh^h'xTh^rjiht, h) - h,T hl ), A lnl ] - Eh^ti^rfQi^h), A lnl ] 



V 3 {h u h) 



(6.37) 

= W 1211 + W 12l2 + W 1213 . 



By (12^,(0, we get 



0(\h\ 2+x ) = E hl Mh u h) - h'r hl ) 2 ] = p 2 {h u h)-E hl [r){h u h)h'r h ,] + \hl{h x )h 
= h' 1(^)1(1 + \h\ x ) - E hl [ V (hi, h)hr hl ]. 

(6.38) 

Since hi \\ h, by (I6.38p . we get 

EhMwfah)] = ^[1(^)11(1 + 0(\h\ x )). (6.39) 
Applying the Holder's inequality, we get 

< (E hl [(Kr hl ) 2+x ])^(E hl [(v(hi,h) - hr hl f]Yl\P hl {B lnl ))^ ( 6 ' 40 ) 

= 0(\h 1 \\h\ 1+X/2 b X J 2 )- 
By fl6^9|) . fl6^0|) .fO|). we get 

W 12 n=0(\h[\\h\b x ). (6.41) 



By Lemma 16. 1[ we get 

W 1212 + W 12 i3 = 0(\h 1 \\h\ 1+X . (6.42) 
By §M,§M,§M, we get 

W l21 = 0{\h\\\h\b x ). (6.43) 
Using Lemma [6.11 and ( 16. 13ft . we get 

^i22 + ^ 123 = 0(|/ir A M). (6.44) 
By (I6736D . f lCTD . flCTD . we get 

Wia = 0(|/iil|/i|6j). (6.45) 
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By ([631, (EM]), dSaS]), we get gjZT]). 

Proof of Lemma \4-S\ We begin with the proof of (I4.32p . Using ( I4.3ip . we get 

]E[h'(T-T hl )r k ,A lnl ] ^(^^(r-r^) 2 ,^]) 1 / 2 ^^]) 1 /^^^^^/ 2 . (6.46) 

The proof of f 14 . 3 3 1) is based on the following reasoning. By (I4.3ip . we get 



0{\h\X) = E[{h{r ~ r hl )) 2 , A lnl ) = E[(hrf, A lnl }- 
- 2E[{hr){hr h ),A Xnl ] + E[(hr hl ) 2 , A lnl ] = Ji - 2J 2 + J 3 



We have 



(6.47) 



J 3 = E hl [(r l (h 1 ,0) + l) 2 Chr hl ) 2 ,A lnl ] 

= E hl [r ] 2 (h 1 ,0)Chr hl ) 2 ,A lnl ]+2E h Mh^)Chr hl ) 2 ,A lnl ] (6.48) 
+ E hl [(hT hl ) 2 , A lnl ] = J 31 + 2 J 32 + J 33 . 



By Lemma 16. 1[ we get 

J 3 i + 2J 32 <C\h\ 2 \h\\ (6.49) 
Estimating similarly to the proof of f l4.2p . fl4.3p . we get 

J 33 = h'I(h)h + 0(\h\ 2 b x n ). (6.50) 

By (JHIlSD-dSISnD, we get 

J 3 = h' 1 I(h 1 )h 1 + 0(\h\ 2 b x ). (6.51) 
By (JS3ZD, (1Q|) .(|53T|. we get 

J 2 = 7^ + 0(|/i| 2 &£)- (6.52) 

By fl£32D,(TOD, we get 

J l -J 2 = 0(\h\ 2 b x ). (6.53) 

This implies f)4.33p . 
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